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PROCESSING OF DIGITAL PICTURE DATA IN A DECODER 



The present invention relates to a decoder for a digital audiovisual transmission 
system, the decoder comprising a processor means for decompressing and displaying 
5 compressed digital picture data and a memory means. 

Broadcast transmission of digital data is well-known in the field of pay TV systems, 
where scrambled audiovisual information is sent, usually by a satellite or satellite/cable 
link, to a number of subscribers, each subscriber possessing a decoder capable of 
10 descrambling the transmitted program for subsequent viewing. Terrestrial digital 
broadcast systems are also known. Recent systems have used the broadcast link to 
transmit other data, in addition to or as well as audiovisual data, such as computer 
programs or interactive applications. 



15 In the most basic level of functionality of such systems, digital audio and video data 
relating to the televised program is transmitted in a compressed format, for example, 
in accordance with the MPEG-2 compression standard. The decoder receives and 
decompresses this data in order to regenerate the televised program. 



20 In addition to simple televised program data, it is becoming increasingly common for 
the decoder to be required to handle other compressed image or graphic data. For 
example, in the case where the decoder includes web browser capabilities, the 
processor of the decoder may be required to receive and decompress downloaded 
digital picture data, for example, still video pictures, graphic icons etc. This picture 

25 information may be displayed over the normal televised program images. 

Such still or moving picture data may be typically received in one of any number of 
compressed formats that are currently used in the context of PC based web browsers. 
For example, a picture may be fomiatted and compressed according to the well-known 
30 GIF or PNG standards, where an image is described by a colour look-up table defining 
a table of colours and a matrix of pixel values referring to this table, the matrix data 
being compressed according to a known compression procedure to prepare the 
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GIF/PNG picture. Alternatively, the picture may be formatted and compressed as a 
still MPEG or JPEG image, in which each pixel is directly associated with a 
red/green/blue colour value. 

5 It is an object of the present invention to provide a means of efficiently handKng such 
downloaded still picture files. 

According to the present invention, there is provided a decoder for a digital 
audiovisual transmission system, the decoder including a processor for decompressing 

10 and displaying compressed still picture data and a memory, characterised in that the 
memoxy comprises a storage memory allocated to receive firom the processor 
decompressed data representing a plurality of still picture images, and at least one 
display memory adapted to hold data representing multiple still picture images 
readable by the processor prior to display, the data representing the plurality of still 

15 picture images being copied firom the storage memory to the display memory for 
subsequent display. 

This division of the memory into a storage and display memory areas introduces a 
degree of flexibility into the display of still image data, in particular by permitting 
20 data representing a given still picture image to be held at the same time in both the 
storage and display means. Data representing one or more still pictures may be held 
indefinitely in the storage memory as long as there is a possible requirement for this 
data, even after the picture has been removed firom the screen by deletion of the data 
firom the display memory. 

25 

In some instances, decompressed image data may simply be copied "as is" into the 
display memory. However, in some cases, the digital image data copied firom the 
storage memory into the display memory is modified or duplicated during the copying 
step, for example, in order to resize the digital image or to copy the same image a 
30 number of times into the display memory. 



Preferably, the processor means is adapted to process image data in the display 
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memory as one layer amongst a plurality of layers superimposed one over the other 
when displayed. 

As discussed above, picture data may be superimposed in a higher layer over, for 
5 example, audiovisual information representing normal televised images. However, in 
one embodiment, the image data in the display memory may be displayed m a layer 
normally used by the processor means to display broadcast audiovisual information. 
This may be the case, for example, where the decoder switches from a "television" 
mode, in which a broadcast emission is displayed, to a * Veb browser'* mode, in which 
10 downloaded picture data from the internet is displayed in place of normal televised 
programmes. 

Advantageously, the memory comprises a second display memory readable by the 
graphic processor means and corresponding to a second layer of displayed image data, 
15 data being copied from the storage memory to the second display memory for 
subsequent display in the second layer of image data. 

Again, as before, the digital image data copied from the storage memory to the second 
display memory may be modified during the copying step. 

20 

In one embodiment, for example, where the decoder switches between a television and 
browser mode, tiae image data in the second display memory may be displayed in the 
lowermost background layer normally used by the processor means to display 
broadcast still audiovisual information. 

25 

Preferably, partial image data is copied from the storage memory to a display memory 
under the control of an application running within the decoder so as to permit display 
of part of an image. This may be desirable, for example, where the decompression 
and downloading of an image into the storage memory by the processor proceeds in 
30 a number of stages. 

In one embodiment, image data is copied from the storage memory into a first or 



.wo 99/41908 



PCT/IB99/00288 



-4- 

second display memory xmder control of a high level application running in the 
processor. Alternatively, this process may be handled automatically by a lower level 
application associated for example with the general handling of received image data. 

5 Compressed digital picture data is preferably stored in a buffer memory prior to 
decompression by the processor. It is not necessary that this buffer means be a single 
integral block of memory particularly if the data arrives in a number of blocks of 
information. In particular, in one embodiment, the buffer comprises a plurality of 
buffer memory elements. Each memory element may correspond, for example to a 
10 block of data downloaded in the decoder. 

Preferably, the decompression and transfer of image data from the buffer memory 
elements to the storage memory, and from the storage memory to a display memory, 
is controlled by the processor such that image information present in the storage 
15 memory is transferred to the display memory at the end- of the decompression of the 
contents of each buffer element. 

It may be the case, for example, that information corresponding to one image will be 
spread over a number of buffer elements. As each buffer is emptied and 
20 decompressed, the information ready for display is transferred immediately to the 
display memory, enabling a partial display of the complete image. 

In addition, or alternatively, the decompression and transfer of a group of images in 
a single image file from the buffer memory to the storage memory, and from the 
25 storage memory to z display memory, is controlled by the processor such that image 
information is transferred from the storage memory to the display memory at the end 
of the decompression of each image in the image file. 

As discussed above, image data may be sent in any number of formats. In one 
30 embodiment, the processor is adapted to decompress picture data sent in a compression 
standard, such as GIF or PNG, that uses a colour look-up table. 
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In addition or alternatively, the processor is adapted to decompress picture data sent 
in a compression standard, such MPEG or JPEG, that uses a red/blue/green colour 
value associated with each pixel. 

5 All functions of decompression, display etc. may be integrated in a single processor. 
Alternatively, the processor in the decoder need not necessarily be embodied in a 
single chip but may be divided, for example, into a general processor handling data 
decompression and a graphic processor for preparing the decompressed data for 
display. 

10 

Similarly, whilst the application may refer to a storage memory, a display memory etc. 
it is to be understood that these need not correspond to physically separate memory 
devices (RAM, ROM, FLASH, etc.) but may correspond to one or more areas 
allocated for this purpose by a controlling application and divided between one or 
15 more physical memory devices. 

The present invention has been discussed above in relation to a decoder apparatus. 
The present invention equally extends to a method of digital image processing within 
a decoder, corresponding to the general and preferred aspects of the invention 
20 discussed above. 

In the context of the present application the term "digital audiovisual transmission 
system" refers to all transmission systems for transmitting or broadcasting primarily 
audiovisual or multimedia digital data. Whilst the present invention is particularly 
25 applicable to a broadcast digital television system, the present invention may equally 
be used in filtering data sent by a fixed telecommimications network for multimedia 
intemet applications etc. 

Similarly, the term "decoder" is used to apply to an integrated receiver/decoder for 
30 receiving and decrypting an encrypted transmission, the receiver and decoder elements 
of such a system as considered separately, as well as to a receiver capable of receiving 
non-encrypted broadcasts. The term equally covers decoders including additional 
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functions, such as web browsers, together with decoders integrated with other devices, 
for example, integrated VHS/decoder devices, digital televisions, or the like. 

The term MPEG refers to the data transmission standards developed by the 
5 International Standards Organisation working group **Motion Pictures Expert Group" 
and notably the MPEG-2 standard developed for digital television applications and set 
out in the documents ISO 13818-1, ISO 13818-2, ISO 13818-3, and ISO 13818-4. 
In the context of the present patent application, the term includes all variants, 
modifications or developments of the basic MPEG formats applicable to the field of ' 
10 digital data transmission. 

There will now be described, by way of example only, a preferred embodiment of the 
present invention, with reference to the attached figures, in which: 

1 5 Figure 1 shows an overview of a digital televisi<5n system; 

Figure 2 shows the elements of the receiver/decoder of Figure 1; 

Figure 3 shows a block diagram of the computer system of the receiver/decoder; 

20 

Figure 4 shows in layer form the image data processed by the graphic processor of 
Figure 2; 

Figure 5 shows the operations carried out in memory for picture data to be displayed 
25 in the MPEG layer of Figure 4; and 

Figure 6 shows the operations carried out in memory for the partial display of picture 
data in the MPEG layer. 

30 An overview of a digital television system 1 according to the present invention is 
shown in Figure 1. The invention includes a mostly conventional digital television 
system 2 that uses the known MPEG-2 compression system to transmit compressed 



wo 99/41908 



PCT/IB99/00288 



-7- 

digital signals. In more detail, MPEG-2 compressor 3 in a broadcast centre receives 
a digital signal stream (typically a stream of video signals). The compressor 3 is 
coimected to a multiplexer and scrambler 4 by linkage 5. 

5 The multiplexer 4 receives a plurality of further input signals, assembles the transport 
stream and transmits compressed digital signals to a transmitter 6 of the broadcast 
centre via linkage 7, which can of course take a wide variety of forms including 
telecommunications links. The transmitter 6 transmits electromagnetic signals via 
uplink 8 towards a satellite transponder 9, where they are electronically processed and 
10 broadcast via notional downlink 10 to earth receiver 12, conventionally in the form 
of a dish owned or rented by the end user. The signals received by receiver 12 are 
transmitted to an integrated receiver/decoder 13 owned or rented by the end user and 
connected to the end user's television set 14. The receiver/decoder 13 decodes the 
compressed MPEG-2 signal into a television signal for the television set 14. 

15 

Other transport channels for transmission of the data are of course possible, such as 
terrestrial broadcast, cable transmission, combined satelhte/cable links, telephone 
networks etc. 

20 In a multichannel system, the multiplexer 4 handles audio and video information 
received from a number of parallel sources and interacts with the transmitter 6 to 
broadcast the information along a corresponding number of channels. In addition to 
audiovisual information, messages or applications or any other sort of digital data may 
be introduced in some or all of these channels interlaced with the transmitted digital 

25 audio and video information. 

A conditional access system 15 is connected to the multiplexer 4 and the 
receiver/decoder 13, and is located partly in the broadcast centre and partly in the 
, decoder. It enables the end user to access digital television broadcasts from one or 
30 more broadcast suppliers. A smartcard, capable of deciphering messages relating to 
commercial offers (that is, one or several television programmes sold by the broadcast 
supplier), can be inserted into the receiver/decoder 13. Using the decoder 13 and 
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smartcard, the end user may purchase commercial offers in either a subscription mode 
or a pay-per-view mode. 

As mentioned above, programmes transmitted by the system are scrambled at the 
5 multiplexer 4, the conditions and encryption keys applied to a given transmission 
being determined by the access control system 15, Transmission of scrambled data 
in this way is well known in the field of pay TV systems. Typically, scrambled data 
is transmitted together with a control word for descrambling of the data, the control 
word itself being encrypted by a so-called exploitation key and transmitted in ' 
10 encrypted form. 

The scrambled data and encrypted control word are then received by the decoder 13 
?r having access to an equivalent of the exploitation key stored on a smart card inserted 
§;' : in the decoder to decrypt the encrypted control word and thereafter descramble the 
^;.15 transmitted data. A paid-up subscriber will receive, for example, in a broadcast 
ff monthly ECM (Entitlement Control Message) the exploitation key necessary to decrypt 

P the encrypted control word so as to permit viewing of the transmission, 

U: An interactive system 16, also connected to the multiplexer 4 and the receiver/decoder 
e20 13 and again located partly in the broadcast centre and partly in the decoder, enables 
the end user to interact with various applications via a modem back chaimel 17. The 
modem back channel may also be used for commimications used in the conditional 
access system 15. An interactive system may be used, for example, to enable the 
viewer to communicate immediately with the transmission centre to demand 
25 authorisation to watch a particular event, download an application etc. 

Referring to Figure 2, the elements of the receiver/decoder 13 or set-top box adapted 
to be used in the present invention will now be described. The elements shown in this 
figure will be described in terms of functional blocks. 

30 

The decoder 13 comprises a central processor 20 including associated 'memory 
elements and adapted to receive input data from a serial interface 21, a parallel 
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interface 22, a modem 23 (comiected to the modem back channel 17 of Fig 1), and 
switch contacts 24 on the front panel of the decoder. 

The decoder is additionally adapted to receive inputs from an infra-red remote control 
5 25 via a control unit 26 and also possesses two smartcard readers 27, 28 adapted to 
read bank or subscription smartcards 29, 30 respectively. The subscription smartcard 
reader 28 engages with an inserted subscription card 30 and with a conditional access 
unit 29 to supply the necessary control word to a demultiplexer/descrambler 30 to 
enable the encrypted broadcast signal to be descrambled. The decoder also includes 
10 a conventional tuner 31 and demodulator 32 to receive and demodulate the sateUite 
transmission before being filtered and demultiplexed by the unit 30. 

Processing of data within the decoder is generally handled by the central processor 20. 
The software architecture of the central processor corresponds to a virtual machine 
15 interacting via an interface layer with a lower level operating system implemented in 
the hardware components of the decoder. This will now be described with reference 
to Figure 3. 

For the purposes of this description, an application is a piece of computer code for 
20 controlUng high level fimctions of the receiver/decoder 13. For example, when the end . 
user positions the focus of a remote controller on a button object seen on the screen 
of the television set and presses a validation key, the instruction sequence associated 
with the button is run. 

25 An interactive application proposes menus and executes commands at the request of 
the end user and provides data related to the purpose of the application. Applications 
may be either resident applications, that is, stored in the ROM (or FLASH or other 
non-volatile memory) of the receiver/decoder 13, or broadcast and downloaded into 
the RAM or FLASH memory of the receiver/decoder 13. 

30 

Applications are stored in memory locations in the receiver/decoder 13 and represented 
as resource files. The resource files comprise graphic object description unit files. 
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variables block unit files, instruction sequence files, application files and data files. 

The receiver/decoder contains memory divided into a RAM volume, a FLASH volume 
and a ROM volimie, but this physical organization is distinct fi-om the logical 
5 organization. The memory may further be divided into memory volumes associated 
with the various interfaces. From one point of view, the memory can be regarded as 
part of the hardware; from another point of view/ the memory can be regarded as 
supporting or containing the whole of the system shown apart from the hardware. 

10 Referring to Figure 3, the computer system can be regarded as centred on a nm time 
engine 40 forming part of a virtual machine 41. This is coupled to applications on 
one side (the *liigh level" side), and, on the other side (the "low level" side), via 
various intermediate logical units discussed below, to the receiver/decoder hardware 
42. The receiver/decoder hardware can be regarded as including various ports 

15 corresponding to the functional blocks discussed in relation to Figure 2 (the interface 
26 for the handset 25, the MPEG stream interface 30, the serial interface 21, the 
parallel interface 22, the interfaces to the card readers 27, 28, and the interface 23 to 
the modemmed back channel 17). 

20 Various applications 43 are coupled to the virtual machine 41. Some of the more 
commonly used ^plications may be more or less permanently resident in the system, 
as indicated at 44, while others will be downloaded into the system, eg firom the 
MPEG data stream or from other ports as required. 

25 The virtual machine 41 includes, in addition to the run time engine 40, some resident 
library fimctions 45 which include a toolbox 46. The library contains miscellaneous 
fimctions in C language used by the engine 40. These include data manipulation such 
as compression, expansion or comparison of data structures, line drawing, etc. The 
library 45 also includes information about device drivers 49 in the firmware of the 

30 receiver/decoder, such as hardware and software version nimibers and available RAM 
space, and a fimction used when downloading a new device 47. Functions can be 
downloaded into the library and stored in FLASH or RAM memory. 
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The run time engine 40 is coupled to a device manager 48 which is coupled to a set 
of devices 47 which are coupled to device drivers 49 which are in turn coupled to the 
ports or interfaces. In broad terms, a device driver can be regarded as defining a 
logical interface, so that two different device drivers may be coupled to a common 
5 physical port, A device will normally be coupled to more than one device driver; if 
a device is coupled to a single device driver, the device will normally be designed to 
incorporate the fiill functionality required for communication, so that the need for a 
separate device driver is obviated. Certain devices may communicate among 
themselves, 

10 

As will be described below, there are three forms of communication from the devices 
47 up to the run time engine: by means of variables, buffers, and events which are 
passed to a set of event queues. 

15 Each function of the receiver/decoder is represented as a device 47. Devices can be 
either local or remote. Local devices include smartcards, SCART connector signals, 
modems, serial and parallel interfaces, a MPEG video and audio player and an MPEG 
section and table extractor. Remote devices executed in a remote location, differ from 
local devices in that a port and procedure must be defined by the system authority or 

20 designer, rather than by a device and device driver provided and designated by the 
receiver/decoder manufacturer. 

The run time engine 40 runs xmder the control of the microprocessor and a common 
application programming interface. They are installed in every receiver/decoder so 
2$ that all receiver/decoders are identical from the appUcation point of view. 

The engine 40 runs applications 43 on the receiver/decoder. It executes interactive 
applications and receives events from outside the receiver/decoder, displays graphics 
and text, calls devices for services and uses fimctions of the library 45 connected to 
30 the engine 40 for specific computation. 

The run time engine 40 is an executable code installed in each receiver/decoder, and 
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includes an interpreter for interpreting and running applications. The engine is 
adaptable to any operating system, including a single task operating system (such as 
MS-DOS). The engine is based on process sequencer units (which take various events 
such as a key press, to carry out various actions), and contains its own scheduler to 
5 manage event queues from the different hardware interfaces. It also handles the 
display of graphics and text. A process sequencer unit comprises a set of action- 
groups. Each event causes the process sequencer unit to move from its current action- 
group to another action-group in dependence on the character of the event, and to 
execute the actions of the new action-group. 

10 

The engine 40 comprises a code loader to load and download applications 43 into the 
receiver/decoder memory. Only the necessary code is loaded into the RAM or FLASH 
memory, in order to ensure optimal use. The downloaded data is verified by an 
authentication mechanism to prevent any modification of an application 43 or the 

15 execution of any unauthorized application. The engine 40 further comprises a 
decompressor. As the application code (a form of intermediate code) is compressed 
for space saving and fast downloading from the MPEG stream or via a built-in 
receiver/decoder mode, the code must be decompressed before loading it into the 
RAM. The engine 40 also comprises an interpreter to interpret the application code 

20 to update various variable values and determine status changes, and an error checker. 

Before using the services of any device 47, a program (such as an application 
instruction sequence) has to be declared as a "client", that is, a logical access-way to 
the device 47 or the device manager 48. The manager gives the client a chent number 
25 which is referred to in all accesses to the device. A device 47 can have several 
clients, the number of clients for each device 47 being specified depending on the type 
of device. A client is mtroduced to the device 47 by a procedure 'T>evice: Open 
Chaimel". This procedure assigns a client number to the client, A client can be taken 
out of the device manager 48 client list by a procedure "Device: Close Charmer*. 

30 

The access to devices 47 provided by the device manager 48 can be either 
synchronous or as3aichronous. For synchronous access, a procedure *T)evice: Call" is 
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used. This is a means of accessing data which is immediately available or a 
functionality which does not involve waiting for the desired response. For 
asynchronous access, a procedure "Device: I/O" is used. This is a means of accessing 
data which involves waiting for a response, for example scaiming tuner frequencies 
5 to find a multiplex or getting back a table from the MPEG stream. When the 
requested result is available, an event is put in the queue of the engine to signal its 
arrival. A further procedure "Device: Event" provides a means of managing 
unexpected events. 

10 As noted above, the main loop of the run time engine is coupled to a variety of 
process sequencer units, and when the main loop encounters an appropriate event, 
control is temporarily transferred to one of the process sequencer units. 

Thus, it can be seen that the computer system implemented in the processor 20 
15 provides a platform having considerable flexibility in enabling an apphcation to 
communicate with a variety of devices. 

Returning to Figure 2, the processing of sound and image data by each of the 
associated processors will now be described in detail. In the case of received audio 

20 and video signals, the MPEG packets containing these signals will be demultiplexed 
and filtered so as to pass real time audio and video data in the form of a packetised 
elementary stream (PES) of audio and video data to dedicated audio and video 
processors or decoders 33, 34. The converted output from the audio processor 33 
passes to a preamplifier 35 and thereafter via the audio output of the receiver/decoder. 

25 The converted output from the video processor 34 passes via a graphic processor 36 
and PAL/SECAM encoder 37 to the video output of the receiver/decoder. The video 
processor may be of a conventional type, such as the ST 3520 A of SGS Thomson. 

The graphic processor 36 additionally receives graphic data for display (such as 
30 generated images etc) from the central processor 20 and combines this information 
with information received from the video processor 34 to generate a screen display 
combining moving images together with overlaid text or other images. An example 
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of a graphic processor adapted to carry out this sort of operation is the CL 93 1 0 of C- 
CUBE. 

In the case of received teletext and/or subtitle data, the conversion of the real time 
PES data to generate the appropriate images may also be handled by dedicated 
processors. However, in most conventional systems, this is handled by the general 
processor 20. 

In point of fact, many of functions associated with the elements such as the graphic 
processor 36, video decoder 34, central processor 20 etc, may be combined or divided 
out in a number of ways, e.g. to integrate the central and graphic processors to form 
a single processor means etc. 

Referring now to Figure 4, the functionality of the graphic processor 36 will now be 
described. As discussed above, the graphic processor receives and processes real time 
video data from the video decoder 34 together with graphic data received from the 
general processor 20 in order to generate an overlaid screen display. 

As shown in Figure 4, the graphic processor 36 is adapted to process input data 
divided into four distinct layers; a background layer 50, an MPEG layer 51, a graphic 
layer 52 and a cursor layer 53. As will be undei^ood, the background layer 50 
corresponds to the lowest layer of the screen display, the other layers being 
progressively superimposed with varying degrees of translucency or opacity over this 
layer. 

In the case where the-decoder is configured to display a broadcast video signal, the 
background and MPEG layers 50, 51 correspond to the stream of data received from 
the video decoder 34, the layer 50 corresponding to MPEG still pictures received from 
the decoder 34 and the layer 51 corresponding to a moving video MPEG signal 
received from the decoder. The division of a video signal into a fixed and a changing 
part is a known characteristic of MPEG compression. 
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Other configurations of the decoder are possible, for example, where the background 
and MPEG layers 50, 51 are completed by picture data in any number of formats 
received from the processor 20. For example, in the case where the decoder is acting 
in web browser configuration, the processor 20 may supply still and/or moving picture 
data to complete the layers 50, 51. The layer 50 may equally correspond, for 
example, to a background colour and the layer 51 to one or more windows displayed 
over the background and containing, for example, information, moving icons or the 
like. The operation of the system in handling picture data will be discussed in more 
below with reference to Figures 5 and 6. 

Still and moving image data from the background and MPEG layers 50, 51 are mixed 
together by the graphic processor 36, as represented by the element 54, and a 
combmed output provided. Mixing of the MPEG layer information 51 over the 
background layer 50 by the graphic processor may carried out using a so-called alpha 
blendmg factor to permit a greater or lesser degree of translucency of the pixels in the 
MPEG layer image. In the case of a moving video image received from the video 
decoder 34, the same blending factor is used for all pixels within the video sequence. 
In the case of picture data from the central processor 20, the value of the blending 
factor for the layer 51 may be different for different parts of the screen. 

The graphic layer 52 is used for texts, shapes, icons etc that will be displayed on the 
screen over the images taken from the layers 50, 51, for example, to permit display 
of a moving icon or the like generated by the processor 20 over a real-time video 
sequence taken from the video decoder 34. 

In a similar manner to the blending carried out for the layers 50, 51, the element 55 
carries out a blending of the graphic layer 52 with the combined output of the layers 
50, 51. Different regions within the graphic layer 52 may be assigned a different 
blending factor and a corresponding different level of translucency depending on the 
characteristics of the data within each region. 

A final layer, the cursor layer, is shown at 53 and represents an opaque cursor image. 
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generated by hardware under control of the central processor 20 and superimposed 
over all the previous layers. As shown at 56, this layer is combined with the simmied 
output from the combination of all previous layers to generate a final combined output 
57 sent to the encoder 37 for subsequent display. Unlike the previous layers, the 
5 cursor presents a continuously opaque appearance and is superimposed over the 
combined layers without any blending. 

Referring to Figures 5 and 6, the operation of a device 47 of the kind shown in Figure 
3 and adapted to decompress and display downloaded picture images in* the MPEG 
10 layer 51 will now be described. In the following description, the term picture is used 
to describe a compressed digital image. Typically, the sorts of picture fomiats used 
may include MPEG still picture, JPEG format picture, PNG format picture, GIF 
format picture, etc. 

15 Whilst the following description will concentrate on the processing and display of a 
single picture, a sequence of still pictures may be displayed one after the other in 
order to generate a moving image sequence. 

Referring to Figure 5, downloaded compressed picture data 60, 61, 62 is initially 
20 stored in a buffer section of the RAM memory of the decoder indicated at 63. This 
buffer memory may be of a type initialised and managed by a high level application 
43 responsible for decoding and displaying images, or an area of memory handled by 
the device manager 48 shown in Figure 3. 

25 Each type of picture file or group of picture files includes a header indicating the 
picture file format {GIF, MPEG, etc.) as well as the information needed to decompress 
the picture file. For example, a GIF format file 62 comprising more than one picture 
has a global header describing the size of the overall area where the two decompressed 
images will be displayed and a specific header for each picture describing its size and 

30 location coordinates within the overall area. 

Following downloading of a compressed picture into the buffer section 63 of the 
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memory, a decompression of the picture data will be effected by the device in 
response to a command PICTURE_DECOMPRESS received from the application. 
The subsequently decompressed image data 63, 64, 65 is stocked in a separate storage 
section of the RAM memory indicated at 66 and reserved for image data eventually 
5 to be displayed in the MPEG layer. Each decompressed image or image sequence is 
given an image identity reference Idl, Id2, Id3 by the device, this ID value being 
supplied to the high level appKcation and used for all subsequent operations to be 
carried out on this data. 

10 Unlike the compressed picture data temporarily held in the application buffer 63, the 
decompressed image data 63, 64, 65 may be held indefinitely in the storage memory 
66 until such time as the application decides to delete the information. 

The storage of decompressed image data in a distinct assigned memory area permits 
15 the data to be manipulated in a number of ways prior to display. For example, a 
resizing of the image may be carried out, either by the device itself, the device 
manager or by a higher level application. Equally, the image may be duplicated in 
order to be displayed at a number of positions on the screen. Conversion of colour 
data associated the image, for example to compensate for limitations in the 
20 functionality of the graphic processor, may also be carried out on the image. 

Modified or unmodified data stored in the memory 66 is passed, in response to a 
command PICTUREJDISPLAY from the application, into a sqjarate RAM memory 
section 67 assigned for images to be displayed in the MPEG layer 51 (see Figure 2). 
25 The size of the display memory 67 corresponds to the screen area. As shown, the 
images Idl and Id2 are displayed at 68 and 69, whilst the image or sequence of 
images Id3 is duplicated and displayed at the positions 70, 71. The information in the 
memory section 67 is fed to the graphic processor 36 in order to create the MPEG 
layer 51, as shown in Figure 2. 

30 

In addition to the transfer of image information between the storage area 66 and 
display area 67, a second transfer may also be carried out to copy information held in 
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the storage area 66 into a memory area (not shown) associated with the display of 
images in the background layer 40 of Figure 2. For example, a single image may be 
replicated and displayed a number of times in the background layer in order to cover 
the screen in a tiling manner. The information stored in the memory area associated 
5 with the background layer is accessed by the graphic processor in the same manner 
as the MPEG display area 67. 

As will be understood, the memory sections 63, 64, 65 do not need to physically 
correspond to uninterrupted memory zones in a single RAM or other memory element. 
10 In particular, the memory area 63 may be divided between a number of buffers. 
Figure 6 shows the steps associated with the decompression of a file 80 containing two 
compressed pictures 81,82 previously downloaded into four associated buffer elements 
or lists of buffers 83, 84, 85, 86. 

15 Each buffer hst corresponds to the buffer areas in which a block of data has been 
downloaded from the MPEG stream. The buffer list itself may designate a number 
of separate buffer areas depending on availability as the information is downloaded. 

At step 87, the appHcation sends a PICTURE_DECOMPRESS command 87 to start 
20 the decompression process. The device allocates a group image Id and starts read the 
buffers. Once the start of a picture is found at step 88, the device assigns an image 
Id and starts decompression of the image. At step 89, the end of the first buffer kst 
is reached and the application sends a PICTURE_ADD_DATA conmiand at step 90 
to command the device to read the next buffer list in the series. 

25 

At this point, only part of the image of the first picture 81 has been decompressed and 
stored in the memory storage area 66. The application may nevertheless decide to 
immediately transfer the partial image to the display memory area 67. 

30 The decompression of the remaining part of the picture 81 then continues until the 
start of the next picture is found at 91. At this point, the whole of the first picture 81 
has been decompressed and stored in the memory area 66. The application may then 
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update the contents of the display memory area 67 by copying the complete image into 
the display area 67. In this way, the whole of the first picture 81 may be displayed 
before the second picture has been decompressed. 

5 At step 92, the device informs the application of the end of the second buffer list 84 
and the application sends a second PICTURE_ADD_DATA command 93 to start the 
reading of the next buffer hst 85. The process is repeated at the end of the third 
buffer list 85 and beginning of the foiulh buffer Ust 86 by the steps 94, 95. Again, 
each' time the end of a buffer is reached at 92, 94, the application may copy the data 
10 that has already been decompressed firom the storage area 66 into the display area 67. 

At step 96, the end of the file is reached and both the pictures 81, 82 have been 
decompressed and loaded into the storage memory 66. At this point, the device 
informs the application of the successfial decompression of the whole file and the 
15 appHcation again copies the contents of the storage memory 66 into the display 
memory 67 to display the complete set of pictures. 
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CLAIMS 

L A decoder for a digital audiovisual transmission system, the decoder including a 
5 processor for decompressing and displaying compressed still picture data and a 
memory, characterised in that the memory comprises a storage memory allocated to 
receive from the processor decompressed data representing a plurality of still picture 
images, and at least one display memory adapted to hold contemporaneously data 
representing multiple still picture images readable by the processor prior to display, 
10 the data representing the plurality of still picture images being copied from the storage 
memory to the display memory for subsequent display. 

2. A decoder as claimed in claim 1 in which the digital image data copied from the 
storage memory into the display memory is modified or duplicated during the copying 

15 step. 

3. A decoder as claimed in claim 1 or 2 in which the processor is adapted to process 
image data in the display memory as one layer amongst a plurality of layers 
superimposed one over the other when displayed, 

20 

4. A decoder as claimed in claim 3 in which the processor is adapted to display the 
image data in the display memory in a layer normally used by the processor means to 
display broadcast audiovisual information. 

25 5, A decoder as claimed in any preceding claim in which the memory comprises a 
second- display memory readable by the processor means and corresponding to a 
second layer of displayed image data, data being copied from the storage memory to 
the second display memory for subsequent display in the second layer of image data. 

30 6. A decoder as claimed in claim 5 in which the digital image data copied from the 
storage memory to the second display memory is modified or duplicated during the 
copying step. 
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7. A decoder as claimed in any preceding claim, in which partial image data is copied 
from the storage memory to a display memory so as to permit display of part of an 
image. 

5 8. A decoder as claimed in any preceding claim, in which image data is copied from 
the storage memory into a first or second display memory imder control of a high 
level application running on the processor, 

9. A decoder as claimed in any preceding claim, in which compressed digital picture 
10 data is stored in a buffer memory means prior to decompression by the processor. 

10. A decoder as claimed in claim 9, in which the buffer means comprises a plurality 
of buffer memory elements. 

15 11. A decoder as claimed in claim 10, in which the decompression and transfer of 
image data from the buffer memory elements to the storage memory, and from the 
storage memory to a display memory, is controlled by the processor such that image 
information present in the storage memory is transferred to the display at the end of 
the decompression of the contents of each buffer element, 

20 

12. A decoder as claimed in any preceding claim, in which the decompression and 
transfer of a group of images in a single image file from the buffer memory to the 
storage memory, and from the storage memory to a display memory, is controlled by 
the processor meaais such that image information is transferred from the storage 

25 memozy to the display memory at the end of the decompression of each image in the 
image file. 

13. A decoder as claimed in any preceding claim, in which the processor is adapted 
to decompress picture data sent in a compression standard that uses a colour look-up 

30 table. 

14. A decoder as claimed in any preceding claim, in which the processor is adapted 
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to decompress picture data sent in a compression standard that uses a red/blue/green 
colour value associated with each pixel. 

15. A decoder as claimed in any preceding claim in which the processor comprises a 
5 general processor for decompressing digital picture data and a graphic processor for 

preparing the decompressed data for display. 

16. A method of digital image processing in a decoder for a digital audiovisual 
transmission system, the decoder comprising a processor for decompressing and 

10 displaying compressed still picture data characterised in that decompressed digital 
image data representing a pluraUty of still picture images received from the processor 
is transmitted to a storage memory and thereafter copied from the storage memory to 
a display memory which holds contemporaneously data representing said multiple 
picture images, the data being read by the processor for subsequent display of such 

15 multiple picture images. 

17. A decoder for a digital audiovisual transmission system substantially as herein 
described. 



20 18. A method of digital image processing in a decoder for a digital audiovisual 
transmission system substantially as herein described. 
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En tant que Tinventeur nomme ci-apres, je declare par le present As a below named inventor, I hereby declare that: 

acte que: 



Men domicile, men adresse postale et ma nationalite sent ceux 
figurant ci-dessous a cote de mon nom. 



; Je crois etre le premier inventeur original et unique (si un seul 
%om est mentionne ci-dessous), ou Tun des premiers co- 
if nventeurs originaux (si plusieurs noms sont mentionnes ci- 
-dessous) de Tobjet revendique, pour lequel une demande de 
1 brevet a ete deposee concemant i'invention intitulee 



-et dont la description est foumie ci-joint a moins que la case 
^.iuivante n'ait ete cochee: 

a ete deposee le 

sous le numero de demande des Etats-Unis ou le 
numero de demande international PCT 

et modifiee le 

(le cas echeant). 



Je declare par le present acte avoir passe en revue et compris ie 
contenu de la description ci-dessus, revendications comprises, 
telles que modifiees par toute modification dont il aura ete fait 
reference ci-dessus. 



Je reconnais devoir divuiguer toute information pertinente a la 
brevetabilite, comme defini dans le Titre 37, § 1.56 du Code 
federal des reglementations. 



My residence, post office address and citizenship are as stated 
next to my name. 



I believe I am the original, first and sole inventor (if only one 
name is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is 
claimed and for which a patent is sought on the invention entitled 



PROCESSING OF DIHTTAL PICTURE DATA 
IN A DECODER 



the specification of which is attached hereto unless the following 
box is checked: 



□ 



was filed on 
as United 



States Application Number or PCT 
Intemational Application Number 

and was amended on 

(if applicable). 



I hereby state that I have reviewed and understand the contents 
of the above identified specification, including the claims, as 
amended by any amendment referred to above. 



I acknowledge the duty to disclose information which is material 
to patentability as defined in Title 37, Code of Federal 
Regulations, § 1.56. 
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Je revendique par ie present acte avoir la priorite etrangere, en 
vertu du Titre 35, § 1 19(a)-(d) ou § 365(b) du Code des Etats- 
Unis, sur toute demande etrangere de brevet ou certificat 
d'inventeur ou, en vertu du Titre 35, § 365(a) du mgrne Code, sur 
toute demande Internationale PCT designant au moins un pays 
autre que les Etats-Unis et figurant ci-dessous et, en cochant la 
case, j'ai aussi indique ci-dessous toute demande etrangere de 
brevet, tout certificat d'inventeur ou toute demande Internationale 
PCT ayant une date de depot precedant celle de la demande a 
propos de laquelle une priorite est revendiquee. 

Prior foreign application(s) 
^g^g^(^^s^ d^ brevet antaieure(s) 



(Number) 
(Ntmiero) 



European 



(Country) 
(Pays) 



(Number) 
(Numero) 



(Country) 
(Pays) 



Je revendique par le present acte tout benefice, en vertu du Titre 
[ 35, § 1 19(e) du Code des Etats-Unis, de toute demande de brevet 
Jprovisoire effectuee aux Etats-Unis et figurant ci-dessous. 



' i( Application No,) 
l!(N* de demande) 

; (Application No.) 
XN de demande) 



(Filing Date) 
(Date de dep6t) 

(Filing Date) 
(Date de depdt) 



Je revendique par le present acte tout benefice, en vertu du Titre 
^35, § 120 du Code des Etats-Unis, de toute demande de brevet 
;effectuee aux Etats-Unis, ou en vertu du Titre 35, § 365(c) du 
'^meme Code, de toute demande Internationale PCT designant les 
■^Etats-Unis et figurant ci-dessous et, dans la mesure ou I'objet de 
^^chacune des revendications de cette demande de brevet n'est pas 
■.yivulgue dans la demande anterieure americaine ou intemationale 
^^¥CT, en vertu des dispositions du premier paragrap^he du Titre 
ij35, § 112 du Code des Etats-Unis, je reconnais devoir divulguer 
toute information pertinente a la brevetabilite, comme defini dans 
le Titre 37, § L56 du Code federal des reglementations, dont j'ai 
pu disposer entre la date de depot de la demande anterieure et la 
date de depot de la demande nationale ou intemationale PCT de 
la presente demande: 

PCT/IB99/QQ288 8 February 1999 
(^plication No.) (Filing Date) 

(N^ de demande) (Date de depot) 



(Application No.) 
(N" de demande) 



(Filing Date) 
(Date de depot) 



Je declare par le present acte que toute declaration ci-incluse est, 
a ma connaissance, veridique et que toute declaration formulee 
a partir de renseignements ou de suppositions est tenue pour 
veridique; et de plus, que toutes ces declarations ont ete 
formulees en sachant que toute fausse declaration volontaire ou 
son equivalent est passible d'une amende ou d'une incarceration, 
ou des deux, en vertu de ia Section 1001 du Titre 18 du Code des 
Etats-Unis, et que de telles declarations volontairement fausses 
risquenl de compromettre la validite de la demande de brevet ou 
du brevet delivre a partir de celle-ci. 



I hereby claim foreign priority under Title 35, United States 
Code, § 119(a)-(d) or § 365 (b) of any foreign application(s) for 
patent or inventor's certificate, or § 365(a) of any PCT 
International application which designated at least one country 
other than the United States, listed below, and have also 
identified below, by checking the box, any foreign application for 
patent or inventor's certificate, or PCT International application 
having a filing date before that of the application on which 
priority is claimed. 



Priority Claimed 
Droit de priorite revendique 



16 February 1998 

(Day/Month/Year Filed) 
(Jour/Mois/Annee de depot) 

□ 

(Day/Month/Year Filed) 
(Jour/Mois/Annee de depdt) 

I hereby claim the benefit under Title 35, United States Code, § 
119(e) of any United States provisional application(s) listed 
below. 



I hereby claim the benefit under Title 35, United States Code, § 
120 of any United States application(s), or § 365(c) of any PCT 
International application designating the United States, listed 
below and, insofar as the subject matter of each of the claims of 
this application is not disclosed in the prior United States or PCT 
International application in the manner provided by the first 
paragraph of Title 35, United States Code, § 112, 1 acknowledge 
the duty to disclose information which is material to patentability 
as defined in Title 37, Code of Federal Regulations, § 1,56 which 
became available between the filing date of the prior application 
and the national or PCT International filing date of this 
application. 



Pending 

(Status) (patented, pending, abandoned) 
(Statut) (brevete, en cours d'examen, abandonne) 

(Status) (patented, pending, abandoned) 
(Statut) (brevete, en cours d'examen, abandonne) 

I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false statements may 
jeopardize the validity of the application or any patent issued 
thereon. 
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Attorney Docket Ho. 1 134^5^,1 00 Wough a/SO/se'^'S^^^^^^^^ 
Patent and Trademari< Office; U.S. DEPARTMENT OF COMMERCE 
Under the Paperwork Reduction Act of 1 995, no persons are required to respond to a coflection of information unless it displays a valid OMB control number. 



French Language Declaration 

POUVOIRS: En lanl que I'inventeur cite, je d(5signe par la 
presenlc r(les) avocat(s) et/ou agenl(s) suivant(s) pour qu'ils 
poursuive(nt) la procedure dc cette demande de brevet ct 
iraite(nt) toute affaire s'y rapporlant avec I'Office des brevets ct 
des marques: (nientionner le noni et le numero 
d'enregistrement). 



POWER OF ATTORNEY: As a named inventor, I hereby 
appoint the following attomey(s) and/or agent(s) to prosecute this 
application and transact all business in the Patent and Trademark 
Ofrice connected therewith: (list name and registration number) 

Jonathan P. Osha, Reg. NO;_3i2S6 , Adenike A. AUevvuya, Reg. N o. 4Z,254 

Alan D. Rosenthal, Reg. Na^7j833_ Y. Renee AUandor, Reg. No . 45,883 
Richard A. Fagin, Reg- N o. 39.182 ^ Jeffrey S. Bergman, Reg. No. 45^925 
K. KaRan Reed, Reg. No.JS^m^ Scott W. Hejny, Reg. No. 45^882 " 
David E. Mixon, Reg. No._ 43,809 .._ Thomas K. Scherer, Reg. No, 45,079 



Adresser toute correspondance a: 



Send Correspondence t o: Jonathan P. Osha 



ROSENTHAL & OSHA LX.P. 
700 Louisiana; Suite AfabO^ — 
Houston, Texas 77002 



Adresser tout appel telephonique a: 
(nom et numero de telephone) 



Direct Telephone Calls to: 
(name and telephone number) 

Jonathan P. Osha 



(713) 228-8600 



1 5 Horn complet de I'unique ou premier in venteur | 


Full name of sole or first inventor Dominioue HAMERY 


] '-Signature de I'inventeur Date 


Inventor's signature ^J^^**^ ^^^^ A^/O^-foo 


;|,Doniicile 


Residence 27 bd Kdmond Rostand,F 92500 Rueil Malmaison^FRAPiClR ^ 

— 


-"Nationalite 


Citizenship FRANCE 


-■^-Adresse postale 


Post Office Address 

2 7 , bd eid mond Rostand .F 92500 Ru«il Mai mi^ison , FRANCE 






Nom complet du second co-inventeur, le cas ech6ant 


Full name of second joint inventor, if any 


Signature du second inventeur Date 


Second Inventor's signature Date 


Domicile 


Residence 


Nationalite 


Citizenship 


Adresse postale 


Post Office Address 







(Foumir les memes renseignements et la signature de tout co- (Supply similar information and signature for third and 

inventeur suppl6mentaire.) subsequent joint inventors.) 
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